Papers by Andrew M. Bean
LLMs Don’t Know Their Own Decision Boundaries: The Unreliability of Self-Generated Counterfactual Explanations (2025.emnlp-main)
Copied to clipboard
Harry Mayne, Ryan Othniel Kearns, Yushi Yang, Andrew M. Bean, Eoin D. Delaney, Chris Russell, Adam Mahdi
| Challenge: | Existing studies on language models' ability to explain their decisions in natural language have focused on self-generated counterfactual explanations (SCEs). |
| Approach: | They evaluate whether LLMs can generate valid counterfactuals and minimal ones . authors suggest that SCEs are, at best, an ineffective explainability tool . |
| Outcome: | The proposed language models can explain their decisions in natural language, the study finds . the models can produce valid counterfactual explanations, but make small edits that fail to change predictions. |